114 research outputs found

    GaitFormer: Revisiting Intrinsic Periodicity for Gait Recognition

    Full text link
    Gait recognition aims to distinguish different walking patterns by analyzing video-level human silhouettes, rather than relying on appearance information. Previous research on gait recognition has primarily focused on extracting local or global spatial-temporal representations, while overlooking the intrinsic periodic features of gait sequences, which, when fully utilized, can significantly enhance performance. In this work, we propose a plug-and-play strategy, called Temporal Periodic Alignment (TPA), which leverages the periodic nature and fine-grained temporal dependencies of gait patterns. The TPA strategy comprises two key components. The first component is Adaptive Fourier-transform Position Encoding (AFPE), which adaptively converts features and discrete-time signals into embeddings that are sensitive to periodic walking patterns. The second component is the Temporal Aggregation Module (TAM), which separates embeddings into trend and seasonal components, and extracts meaningful temporal correlations to identify primary components, while filtering out random noise. We present a simple and effective baseline method for gait recognition, based on the TPA strategy. Extensive experiments conducted on three popular public datasets (CASIA-B, OU-MVLP, and GREW) demonstrate that our proposed method achieves state-of-the-art performance on multiple benchmark tests

    Ariadne's Thread:Using Text Prompts to Improve Segmentation of Infected Areas from Chest X-ray images

    Full text link
    Segmentation of the infected areas of the lung is essential for quantifying the severity of lung disease like pulmonary infections. Existing medical image segmentation methods are almost uni-modal methods based on image. However, these image-only methods tend to produce inaccurate results unless trained with large amounts of annotated data. To overcome this challenge, we propose a language-driven segmentation method that uses text prompt to improve to the segmentation result. Experiments on the QaTa-COV19 dataset indicate that our method improves the Dice score by 6.09% at least compared to the uni-modal methods. Besides, our extended study reveals the flexibility of multi-modal methods in terms of the information granularity of text and demonstrates that multi-modal methods have a significant advantage over image-only methods in terms of the size of training data required.Comment: Provisional Acceptance by MICCAI 202

    MS-MT: Multi-Scale Mean Teacher with Contrastive Unpaired Translation for Cross-Modality Vestibular Schwannoma and Cochlea Segmentation

    Full text link
    Domain shift has been a long-standing issue for medical image segmentation. Recently, unsupervised domain adaptation (UDA) methods have achieved promising cross-modality segmentation performance by distilling knowledge from a label-rich source domain to a target domain without labels. In this work, we propose a multi-scale self-ensembling based UDA framework for automatic segmentation of two key brain structures i.e., Vestibular Schwannoma (VS) and Cochlea on high-resolution T2 images. First, a segmentation-enhanced contrastive unpaired image translation module is designed for image-level domain adaptation from source T1 to target T2. Next, multi-scale deep supervision and consistency regularization are introduced to a mean teacher network for self-ensemble learning to further close the domain gap. Furthermore, self-training and intensity augmentation techniques are utilized to mitigate label scarcity and boost cross-modality segmentation performance. Our method demonstrates promising segmentation performance with a mean Dice score of 83.8% and 81.4% and an average asymmetric surface distance (ASSD) of 0.55 mm and 0.26 mm for the VS and Cochlea, respectively in the validation phase of the crossMoDA 2022 challenge.Comment: Accepted by BrainLes MICCAI proceedings (5th solution for MICCAI 2022 Cross-Modality Domain Adaptation (crossMoDA) Challenge

    Efficient Joint Optimization of Layer-Adaptive Weight Pruning in Deep Neural Networks

    Full text link
    In this paper, we propose a novel layer-adaptive weight-pruning approach for Deep Neural Networks (DNNs) that addresses the challenge of optimizing the output distortion minimization while adhering to a target pruning ratio constraint. Our approach takes into account the collective influence of all layers to design a layer-adaptive pruning scheme. We discover and utilize a very important additivity property of output distortion caused by pruning weights on multiple layers. This property enables us to formulate the pruning as a combinatorial optimization problem and efficiently solve it through dynamic programming. By decomposing the problem into sub-problems, we achieve linear time complexity, making our optimization algorithm fast and feasible to run on CPUs. Our extensive experiments demonstrate the superiority of our approach over existing methods on the ImageNet and CIFAR-10 datasets. On CIFAR-10, our method achieves remarkable improvements, outperforming others by up to 1.0% for ResNet-32, 0.5% for VGG-16, and 0.7% for DenseNet-121 in terms of top-1 accuracy. On ImageNet, we achieve up to 4.7% and 4.6% higher top-1 accuracy compared to other methods for VGG-16 and ResNet-50, respectively. These results highlight the effectiveness and practicality of our approach for enhancing DNN performance through layer-adaptive weight pruning. Code will be available on https://github.com/Akimoto-Cris/RD_VIT_PRUNE

    Ruthenium nanoclusters modified by zinc species towards enhanced electrochemical hydrogen evolution reaction

    Get PDF
    Ruthenium (Ru) has been considered a promising electrocatalyst for electrochemical hydrogen evolution reaction (HER) while its performance is limited due to the problems of particle aggregation and competitive adsorption of the reaction intermediates. Herein, we reported the synthesis of a zinc (Zn) modified Ru nanocluster electrocatalyst anchored on multiwalled carbon nanotubes (Ru-Zn/MWCNTs). The Ru-Zn catalysts were found to be highly dispersed on the MWCNTs substrate. Moreover, the Ru-Zn/MWCNTs exhibited low overpotentials of 26 and 119 mV for achieving current intensities of 10 and 100 mA cm−2 under alkaline conditions, respectively, surpassing Ru/MWCNTs with the same Ru loading and the commercial 5 wt% Pt/C (47 and 270 mV). Moreover, the Ru-Zn/MWCNTs showed greatly enhanced stability compared to Ru/MWCNTs with no significant decay after 10,000 cycles of CV sweeps and long-term operation for 90 h. The incorporation of Zn species was found to modify the electronic structure of the Ru active species and thus modulate the adsorption energy of the Had and OHad intermediates, which could be the main reason for the enhanced HER performance. This study provides a strategy to develop efficient and stable electrocatalysts towards the clean energy conversion field

    InstructCoder: Empowering Language Models for Code Editing

    Full text link
    Code editing encompasses a variety of pragmatic tasks that developers deal with daily. Despite its relevance and practical usefulness, automatic code editing remains an underexplored area in the evolution of deep learning models, partly due to data scarcity. In this work, we explore the use of large language models (LLMs) to edit code based on user instructions, covering a broad range of implicit tasks such as comment insertion, code optimization, and code refactoring. To facilitate this, we introduce InstructCoder, the first dataset designed to adapt LLMs for general-purpose code editing, containing highdiversity code-editing tasks. It consists of over 114,000 instruction-input-output triplets and covers multiple distinct code editing scenarios. The dataset is systematically expanded through an iterative process that commences with code editing data sourced from GitHub commits as seed tasks. Seed and generated tasks are used subsequently to prompt ChatGPT for more task data. Our experiments demonstrate that open-source LLMs fine-tuned on InstructCoder can edit code correctly based on users' instructions most of the time, exhibiting unprecedented code-editing performance levels. Such results suggest that proficient instruction-finetuning can lead to significant amelioration in code editing abilities. The dataset and the source code are available at https://github.com/qishenghu/CodeInstruct

    Effectiveness of acupuncture as auxiliary combined with Western medicine for epilepsy: a systematic review and meta-analysis

    Get PDF
    BackgroundAlthough more and more clinical studies have shown that acupuncture as an auxiliary combined with Western medicine is effective in the treatment of patients with epilepsy, no systematic reviews of acupuncture as a treatment for epilepsy have been published. Hence, we conducted this meta-analysis to evaluate the effect of acupuncture treatment on patients with epilepsy.MethodsThis study retrieved randomized controlled trials (RCTs) of acupuncture treatment for epilepsy from various electronic databases including PubMed, Embase, Cochrane Library, China National Knowledge Infrastructure, Chinese BioMedical Literature Database, and Wangfang database. These studies evaluated the effectiveness of acupuncture as an auxiliary treatment combined with Western medicine for patients with epilepsy. The methodological quality of the studies was assessed using the Cochrane Handbook for Systematic Reviews of Interventions.ResultsA total of 17 RCTs involving a total of 1,389 participants were included. The results showed that acupuncture combined with Western medicine improved the effective rates of treatment (OR: 4.28; 95% CI: 3.04–6.02; p < 0.001), and reduced the seizure frequency of patients (SMD: −3.29; 95% CI: −3.51 to −3.07; p < 0.001) and the EEG discharge frequency (SMD: −5.58; 95% CI: −7.02 to −4.14; p < 0.001). Regarding the quality of life and adverse events, the acupuncture group was superior to the control group in improving the overall quality of life of patients with epilepsy (SMD: 14.41; 95% CI: 12.51–16.32; p < 0.001) and decreased adverse events (OR: 0.38; 95% CI: 0.23–0.63, p < 0.001).ConclusionThe results of the analysis suggested that acupuncture combined with Western medicine is probably helpful in patients with epilepsy, but strong supportive data are not yet available. Given that this study is based on a low to moderate evidence-based analysis, the conclusions should be viewed with caution.Systematic review registrationPROSPERO, identifier no. CRD42023409923
    • …
    corecore